Effects of fermion-boson interaction in neutral atomic systems 
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We investigate the collective excitations of '^He-*H[e mixture films at zero temperature within 
random phase approximation and linear response theory. In low concentration regime of ^He, a 
level repulsion between zero sound and third sound mode is derived, which opens the possibility to 
observe quantum mechanical coherence between ^He particle-hole pair and the condensate of *He. 
We also investigate the ^He-*He vertex corrections in ladder approximation and show that the third 
branch, the combined mode of fermionic particle-hole pair and the third sound quanta, provides a 
unique correction to Landau / function. Some implications to the fermion-boson mixture of alkali 
atoms in a potential trap are discussed. 

PACS numbers: 67.60.Fp, 67.57.Jj, 68.15.-fe 



Two dimensional (2D) Fermi liquid is one of the most 
important subjects in condensed matter physics; they are 
in deep connection with high-temperature superconduc- 
tivity in cuprates and alkah-doped fullerene, and with 
quantum Hall effect. Free surface of superfiuid ^He bulk 
liquid or films provides ideal fields for 2D fermi systems 
free from impurities and inhomogeneities in chemical po- 
tential due to randomness of walls or substrates. In par- 
ticular, phase separated '^He-'*He mixture films has been 
a subject of theoretical and experimental interest for the 
last two decades 0. At very low temperature, it is well- 
known that ^He atoms are bound to the surface of su- 
perfiuid ^He 0, and behave as a well-defined 2D Fermi 
liquid Therefore, it is regarded as a good candi- 

date of 2D fermion-boson systems. The nature of '^He and 
^He films depends strongly on system parameters, such as 
concentrations, temperature, and van der Waals poten- 
tial from substrates. This richness of the parameters has 
provided various suggestions such as Cooper pairing 'Sj 
and dimerization 6, 7, 8] of ''He, as well as_sup|)ression 
of the superfluidity 9] and Casimir effect |[lO|, [ll| of su- 
perfiuid "^He films. 

In this 2D fermion-boson system, '^He particles inter- 
act with one another through thickness variation of ^He 
films, i.e., third sound driven by van der Waals poten- 
tial as well as direct interactions. A fascinating fea- 
ture of this system is that characteristic energies can be 
easily tuned by varying the thickness of ''He and '''He 
films continuously. Therefore, it is expected that in- 
terference between excitations is enhanced, and nona- 
diabatic effect becomes relevant when suitable param- 
eters are chosen. In this paper, we report a theoretical 
study of response to the spectrum of collective excita- 
tions when thickness of the mixture films is varied at 
zero temperature. We will show that a level repulsion 
between zero sound and third sound mode takes place. 
Moreover, the third branch is derived, which we inter- 
pret as combined mode of fermionic particle-hole pair 
and third sound phonon, by calculating the vertex func- 
tion in some detail. We also calculate the contribution 
of this collective excitation to Landau / function. 

We assume that the system forms a phase-separated 



double layer, i.e., normal ''He liquid covering '^Hc which 
consist of a superfluid layer and a non-superfluid "inert 
layer" |^ . In this system, particles are sensitive to 
the modulation of substrate van der Waals potential due 
to the thickness variation of ''He and ''He films, especially 
at low concentrations. We take account of this effect into 
interactions between particles and include other effects in 
hydrodynamic masses. The effective Hamiltonian which 
consists of third sound phonons and "'He quasiparticles 
interacting with one another and phonons was derived by 
one of the authors , and has the following form 

k,cr ^ q 

+ '^f^ciblbq + J29^(^^ + b-ci)P-ci,<y, (1) 
q q.o^ 

where correlation between superfluid and inert layers and 
surface tension of the films are neglected for simplicity. 
These approximation may be allowed, except the region 
where the structure normal to substrate becomes remark- 
able 0. Here, pq,cr — X^k '^k o-'^k+q,(T is Fourier trans- 
formation of density operator and a =t, i and are 
spin indices and number of "^He atoms respectively. The 
spectrum of third sound phonon and coupling energies 
are respectively given by 
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where the subscripts 3 and 4 denote ''He and ''He; n^, hi 
are average bulk densities and average thickness of the 
films, and rrii, Ui are hydrodynamic masses and charac- 
teristic van der Waals energies. S and d are surface area 
and thickness of inert layer. In the equations above, cb 
is the velocity of third sound phonon which strongly de- 
pends on concentrations through ^13 and /14, and can be 
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FIG. 1: Real part and imaginary part (inset) of spectrum 
are plotted with t<j/g = c + i7asa function of concentration 
of "^He. Here, we fix the thickness of ^He films to d =25.3 
iimoXjvcL , /i4 =25.8 pmol/m^, and graphite sheet is modeled 
as a substrate. 
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FIG. 2; Dynamical structure function S (g, oj) for a fixed 
wave number q is plotted as a function of concentration of 
^He and velocity of excitation. Third sound evolves to lower 
branch and spectral weight S'''*''(g,w) is broadened as con- 
centration of ^He quasiparticle increases. Parameters u^, d 
and /i4 are the same as the Fig.l. 
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It is suggested that the third sound velocity Eq.(5) needs 
some corrections when the submonolayer regime of '^He 
is considered 0| . We neglect these corrections here, be- 
cause they does not play a crucial role in this paper. 

Similar model has been studied in detail to inves- 
tigate the equation of state and correlation energy of 
3He El whereas we will focus on the low energy 
collective behaviors of mixture below. To investigate the 
spectrum of collective excitations, we shall consider a 
2x2 susceptibility matrix, which is in connection with 
area density fluctuations (thickness variation) in linear 
response theory, in which interactions are treated within 
random phase approximation (RPA) jl8lll9j |. The unper- 
turbed susceptibility and interaction matrix of the mix- 
tures has the following form 
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Here, ^3 and Xi ^^re the susceptibilities of 2D pure 
fermion and boson systems, and at zero temperature they 
are given as 
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and 



X4(q,t^) 



2ujq/h 



(8) 



where ek — jlra^i — ep with ep being Fermi energy 
and n(ek), wf, -^(0) = m^SI-Kfi? are Fermi-Dirac distri- 
bution, Fermi velocity and density of states at Fermi sur- 
face of '^He, respectively. In the equations above, terms 
of order are neglected since we are interested in low 
energy excitations. 

Within the RPA treatment, the susceptibility matrix 
of mixture films can be obtained as a solution of x = 



X 



(0) 



(°)yx in, which is 



X 



XRPA 
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5qX3X4 X4(l - -^3X3) 
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where the factor 2 in the last term of the denominator 
comes as a result of summing over the spin indices. If 
(7q = 0, it can be easily seen that this susceptibility ma- 
trix becomes diagonal whose elements are usual RPA sus- 
ceptibility, X3/(l ~ ^^3X3)1 s-nd X4- Therefore, two poles 
of this matrix correspond to the spectrum of two eigen- 
modes; one is zero sound branch of '^He due to the nonlin- 
earity of van der Waals potential, and the other is third 
sound branch of *He. For the third sound phonon, this 
RPA treatment is equivalent to solving Dyson's equation 
in Migdal approximation where effective self-energy 
of third sound is 2gqX3/(l — i;3X3)- At zero tempera- 
ture and long wave length limit, dispersion relation and 
damping rate are calculated numerically and the results 
are shown in Fig.l. Here, we employs the parameters 
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Ui and d, modeling the double layer system on the flat 
surface of graphite For the films, we fix the thick- 
ness of *He films, and alter the ^He concentration from 
a small fraction of the monolayer to one layer (a mono- 
layer corresponds to the density 10.6 /imol/m^ for '^He 
and 12.9 /imol/m^ for ^He 8j). One can see that these 
two branches exhibit a level repulsion characteristic of 
reactively coupled oscillators. Hence, the two branch are 
well-hybridized and show the clear level splitting around 
the region /13 « 0.3 layer (~ 3.2 ^mol/m^), where cb 
crosses the bare zero sound velocity cp = ^^^ tip with 

V — N{0)v3. As the concentration of ^He particles in- 
creases further, one can see from the dynamical structure 
function of "'He, S'^^''-'(q, w), defined as 



-Imx(q,w) 



/^(33) ^(34) 

1 ^(43) sm 



(10) 



that third sound spectrum evolves continuously from the 
upper branch (+) into the lower one (— ), and gets into 
the particle-hole continuum of the ■^He. This situation 
results in the strong damping of bosonic third sound by 
resonantly absorbing ■^He particle-hole pair. This behav- 
ior of the spectrum has not been verified [TEL To 
our knowledge, there is no experimental result, investi- 
gating carefully around the region where velocities of two 
components are close to each other. 

As for the damping rate, the beginning of damping 
of hybridized mode can be seen in discontinuous con- 
centration dependence of sound velocity in lower branch. 
Unlike conventional electron-phonon systems in metals, 
the ratio of sound velocities of two components is of or- 
der unity; therefore the effect of this damping is not 
small and has a possibility to be observed (see inset 
of Fig.l). Indeed, imaginary part of the spectrum can 
be easily estimated to have a behavior ^ — [A/(2 + 
^)\ [cb/ "v/^^f ~ "-bJ (cb?) at high concentration regime of 
^He, i.e., cb < vf- Here, A = -A^(0)gqX4(q, 0) > is a 
dimensionless phonon exchange coupling constant, which 
is determined by Fermi energy and van der Waals poten- 
tial |5l|. Around the region cb ~ wp, it has a strong peak 
which amounts to about 15 % of the spectrum. In three 
dimensional (3D) case, similar level repulsion and the 
damping of bosonic mode are discussed by Yip with di- 
lute boson-fermion mixture gasses of alkali atoms, such 
as ^^K-^'^K and ^Li-^Li, in mind In his system, 

fermions are spin polarized because of magnetic trapping 
and fermion-fermion interaction is not included, hence 
zero sound, due to phonon exchange interaction only, is 
discussed. 

Having established the existence of the level repulsion 
and the damping within the RPA treatment, we will dis- 
cuss effect of vertex function for ■^He-'*He exchange inter- 
action in more detail. Unlike conventional metals, "De- 
bye energy" is comparable or greater than ep in our sys- 
tem. This situation opens the possibility of scenario in 
which nonadiabatic effects are relevant and new qualita- 
tive phenomena arise from vertex corrections. Here, we 



treat the vertex function in ladder approximation [22| . 
i.e., as a solution of Bethe-Salpeter equation 

r(q, iw™) = .9q - fcBT^^5k-p 

ikn k 

X XiiP -Km ~ 'i'k„)G(k,ikn) 

xG{k - q, ikn - jc^m)r(q, icj,„), (11) 

where G(k, ifc™) is a bare single-particle propagator of 
■^He quasiparticles with ikn, i^m being fermionic and 
bosonic Matsubara frequency. We assume that the vertex 
function depends only on the energy-momentum trans- 
fer. Here, external fcrmion frequency ipi is set to zero 
after analytic continuation. This approximation may be 
justified when low energy particle-hole excitations give 
dominant contribution. As for the external wave vector 
p, we introduce as a cutoff of wave number transfer 
|p— k| 23], which is of order of inverse of coherence length 
of "^Hc films. At zero temperature and long wave length 
limit, this equation is solved analytically and the vertex 
function has the following form 



r(q,c^) 

C(q,c.) 



1 + 1 C7(q,c.) + 



(12) 



1 



(13) 



Here, we neglect polarization contribution of the second 
term of right hand side in Eq.(ll), which has the same 
dynamical (w ^ 0, q = 0) and static limit (w = 0, 
q — *■ 0), because it gives only quantitative difference in 
the denominator of vertex function. Obviously, Migdal 
approximation breaks down qualitatively in the region 
uj « vpq and the vertex function diverges to ±cxd, as 
Lo — > ujQ from above and below respectively. Here, loq is 
obtained as 



l + A/2 
%/TTA 



Vpq 



A(1 + AV2) {vpqf 
8(l-f A/2)2 (cB^c)^ 



(14) 



This means that dynamical phonon-mediated '^He-'^He 
interaction becomes strongly enhanced and even changes 
its sign. Its behavior resembles Feshbach resonance in al- 
kali atom gasses |23, but this frequency dependent "po- 
tential" cannot be used in a Hamiltonian formalism like 
a scattering length of alkali atoms since the strong fre- 
quency dependence of interaction imposes one to take 
the strong retardation effect into account We ex- 

pect this break down of perturbation theory not to lead 
to the violation of Fermi liquid theory. Indeed, the 
pole provides only a subdominant correction to imagi- 
nary part of single-particle self-energy that behaves as 
IniEP(fci?,w) ~ X^epif^/ (-fY foi" w ^ 0^ (subscript p 
denotes the pole contribution). Moreover, nonzero quasi- 
particle residue Z at the Fermi surface can be derived 
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with use of Kramers-Kronig relation. Thus the quasipar- 
ticle is well-defined, even with the singularity in vertex 
function. 

We shall investigate the effect of this phonon exchange 
vertex function to the spectrum of excitations. The 
singularity of r(q, w) in long wave length limit implies 
the existence of low-lying excitation which obeys Bose- 
Einstein statistics. We interpret the pole as a excita- 
tion energy of an additional collective mode. Physically, 
this third branch corresponds to a combined mode of "^He 
particle-hole pair and third sound phonon. It may be con- 
sidered as the pole of Dc (q, oj) , which is Fourier transfor- 
mation of-E.(7^t(0qW/O-q.<.(O)+Pq,.(i)0-q(O))> S3 • 

Here, T* is usual Wick's time ordering operator, (j)q{t) 
is field operator of third sound phonon, and (• • • ) de- 
notes the average for the ground state of mixture. It 
should be noted that this "susceptibility" contains multi- 
phonon processes, thus relation with area density fluc- 
tuations is no longer linear. The third spectrum ob- 
tained by numerical calculation lies above particle-hole 
continuum and between upper and lower branch. Fur- 
thermore, one can see from dynamical structure function 
S'~^{q,u!) = —l/irlmDc that the combined mode branch 
has considerable spectral weight except the region where 
zero sound and third sound are well-hybridized. The be- 
havior of this spectral weight causes the resonant nature 
of S'~^{q,uj) at w « cbQ- Indeed, the combined mode 
is completely suppressed as ujc —> c^q. Physically, this 
behavior causes the mode- mode repulsion TSj. 

We also investigate the correction of the combined 
mode to Landau Fermi liquid parameter. At zero temper- 
ature, it is obtained as f^y{9) = STicrCk, ei^)/6ny {ey^') 

with k • k = kpCosB Since the combined mode does 
not contribute to .ft i (9) , we can obtain the Landau / 
function as follows [23 

/ttW = /uW-p./-- ^"^^^-^'^^ (15) 

J IT s gk-k' 

Here, P. denotes the principal value of the integral. The 
pole contribution, i.e. the collective mode contribution, 
comes from delta function part of ImF, and is obtained 
as 



iV(O)(/f^(0)-/f,(0)) 



■-(1 

16 V 



TT^ TTrSm - 

2 (cBgc)2 ^2- 



(16) 



In addition, contribution from the particle-hole contin- 
uum of vertex function can be obtained from the real 
part of r with use of Kramers-Kronig relation, and has 
the following form 



-A 



1 



|C(2A:Fsin(f),0)' 



(17) 



These contributions are not singular. Additionally, the 
pole gives rise an additional factor A^ to correction for 
Landau / function. Therefore, third branch contribution 
may become important at strong coupling region. 



Wc/cBq= 1.4 (RPA) 
tUc / Cgq = 0.8 
aJc / Cgq = 1.0 
Wc/cBq= 1.4 




FIG. 3: Dynamical structure function of the combined mode, 
S^(g,tj), is plotted for three parameter regimes as a function 
ofu/q. One can see that there exists a sharp spectral weight 
between third sound and zero sound, which does not occur 
within RPA treatment. At ojc/cbQ = 1.4, spectral weight of 
third branch is found to be about 30 % of all. At ujc/cBq = 
1.4, spectral weight of third branch is found to be about 30 % 
of all. At the region ~ cb?, the combined mode is strongly 
suppressed by mode-mode repulsion effect. 



As for the observability, this third branch may be ob- 
served under the strong van der Waals potential, since 
it is inherently related to the interaction. Therefore ex- 
periment with low-thickness superfluid '*He films and the 
substrate which has strong van der Waals potential, such 
as gold, is desired. Recent experiment makes it possi- 
ble to evaluate the Landau Fermi liquid parameter as 
a function of ^He concentration 0, therefore the third 
branch contribution Eq.(16) has a possibility to be ob- 
served at the low-concentration regime of ^He. Further, 
it should be noted that there is no restriction in system 
components in our method, therefore these discussions 
can be easily applied to quasi-2D alkali atom gases in 
which phase separation does not occur. Regarding exis- 
tence of the third branch, alkali gases system may be bet- 
ter suited for experimental verification because fermion- 
boson interaction can be almost freely changed as well 
as other system parameters. In such a case, zero sound 
with higher spin channel may be taken into account |26l | . 

In conclusion, we have investigated the effects of 
phonon exchange process to the collective excitations of 
■^Hc and *He at absolute zero. Two remarkable features 
have been found. One is the level repulsion between 
zero sound and third sound due to ^He-^He interaction. 
This repulsion becomes remarkable at region where sound 
velocities of two components are close to each other. 
This situation results in hybridization of two eigenmodes 
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and finite level splitting in the spectrum. Furthermore, 
damping of third sound, resonant decay into particle- hole 
pair excitation, is also shown to be significant when the 
third sound velocity is smaller than v-p. The other is that 
Migdal's theorem breaks down when nonadiabatic effect 
of ■^He-^'He interaction is considered. A third branch 
comes in; this may be interpreted as a combined mode 
of particle-hole pair and third sound quanta. The con- 
centration dependence of dynamical structure factor and 
the correction to Landau Fermi liquid parameter of this 
collective excitation are also discussed. 

In the discussions above, we have focused on low en- 



ergy collective behavior and we have not considered two- 
body scattering problem. It is expected that interaction 
between '^He and ^He induces the effective ^He-^He at- 
traction and leads to spin-singlet and neutral superfluid 
formation 5,6j,T,8\. We consider in future work the pos- 
sibility that nonadiabatic phonon exchange may either 
drive the system into a superfluid transition or polaron 
formation. 

The authors would like to thank M. Nishida, S. 
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